This unit describes the skills and knowledge required to capture and store transactional and non-transactional big data obtained from a variety of sources. It involves using methodologies and techniques to obtain big data sets. It also involves analysing and storing the captured big data according to industry practices and organisational policies, procedures and protocols.

It applies to those in a broad range of industries and job roles who, under some supervision and guidance, are responsible for obtaining, preparing and storing big data.

No licensing, legislative or certification requirements apply to this unit at the time of publication.

The candidate must demonstrate the ability to complete the tasks outlined in the elements, performance criteria and foundation skills of this unit, including evidence of the ability to:

capture, apply data cleansing, and store one set of transactional and one set of non-transactional big data relating to specific workplace needs

create a report relating to data capture for a specific workplace need for at least one set of transactional and one set of non-transactional big data.

The candidate must be able to demonstrate knowledge to complete the tasks outlined in the elements, performance criteria and foundation skills of this unit, including knowledge of:

legislative requirements relating to big data capture and storage, including data protection, security and privacy laws and regulations

organisational policies and procedures relating to big data capture and storage, including for:

capturing, storing and reporting transactional and non-transactional sources of big data

cleansing methodologies when capturing big data

business intent of big data capture

re-creating and recovering big data lost during capture process

privacy concerns of predictive analytics organising security and retrieval of big data

quality assuring captured big data

data capture techniques to produce analytic ready data and datasets

big data features and their impact on data capture and storage, including velocity, volume, variety, value, and veracity

variability and complexity of big data:

structured and unstructured

transactional and non-transactional

framework for distributed storage of big data

platform solutions for capturing and storing big data

key features of organisational products and services related to big data capture

technologies, techniques and protocols for capturing, storing and retrieving big data

secure data access and control mechanisms of captured and stored big data

high availability and scalability challenges with big data.

Skills must be assessed in a workplace or simulated environment where conditions are typical of a work environment that uses big data.

Access is required to:

information and data sources to inform big data capture

information and telecommunications equipment required to capture and store big data

industry standards, organisational procedures, and legislative requirements required to demonstrate the performance evidence.

Assessors of this unit must satisfy the requirements for assessors in applicable vocational education and training legislation, frameworks and/or standards.

This section describes those language, literacy, numeracy and employment skills that are essential to performance but not explicit in the performance criteria.

Data Literacy – Data Literacy